A Nonparametric Bayesian Model of Multi-Level Category Learning
نویسندگان
چکیده
Categories are often organized into hierarchical taxonomies, that is, tree structures where each node represents a labeled category, and a node’s parent and children are, respectively, the category’s supertype and subtypes. A natural question is whether it is possible to reconstruct category taxonomies in cases where we are not given explicit information about how categories are related to each other, but only a sample of observations of the members of each category. In this paper, we introduce a nonparametric Bayesian model of multi-level category learning, an extension of the hierarchical Dirichlet process (HDP) that we call the tree-HDP. We demonstrate the ability of the tree-HDP to reconstruct simulated datasets of artificial taxonomies, and show that it produces similar performance to human learners on a taxonomy inference task.
منابع مشابه
Nonparametric Bayesian Multi-task Learning with Max-margin Posterior Regularization
Learning a common latent representation can capture the relationships and share statistic strength among multiple tasks. To automatically resolve the unknown dimensionality of the latent representation, nonparametric Bayesian methods have been successfully developed with a generative process describing the observed data. In this paper, we present a discriminative approach to learning nonparamet...
متن کاملA Multi-scale Nonparametric/Parametric Hybrid Recognition Strategy with Multi-category Posterior Probability Estimation
The synthesis of an effective multi-category nonlinear classifier with the capability to output calibrated posterior probabilities to enable post-processing is of great significance in practical recognition situations in that the posterior probability reflects the assessment uncertainty. In this paper, a multi-scale nonparametric and parametric hybrid recognition strategy is developed for this ...
متن کاملBayesian classification with discrete templates
We outline the principles of Bayesian classification using discrete templates. We show that this form of nonparametric modelling is semi-supervised learning and embodies multi-level hierarchical modelling to infer all model parameters from the data. CU8 GAIA-C8-TN-MPIA-CBJ-061 Document History Issue Revision Date Author Comment 1 1 2011-08-29 CBJ Added softmax implementation 1
متن کاملAnalyzing human feature learning as nonparametric Bayesian inference
Almost all successful machine learning algorithms and cognitive models require powerful representations capturing the features that are relevant to a particular problem. We draw on recent work in nonparametric Bayesian statistics to define a rational model of human feature learning that forms a featural representation from raw sensory data without pre-specifying the number of features. By compa...
متن کاملOne-Shot Learning with a Hierarchical Nonparametric Bayesian Model
We develop a hierarchical Bayesian model that learns categories from single training examples. The model transfers acquired knowledge from previously learned categories to a novel category, in the form of a prior over category means and variances. The model discovers how to group categories into meaningful super-categories that express different priors for new classes. Given a single example of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011